1 RANDOMIZED SUPERPIXELS TO ENHANCE MULTILEVEL IMAGE QUALITY 

2 IN ECONOMICAL, FAST INCREMENTAL-PRINTING ERROR DIFFUSION 

3 
4 

5 RELATED PATENT DOCUMENTS 
6 

7 Closely related documents are other, coowned U. S. 

8 utility-patent applications filed in the United States 

9 Patent and Trademark Office substantially contemporaneous - 

10 ly with this document — and also hereby incorporated by 

11 reference in their entirety into this document. One is in 

12 the names of Gil et al . , and identified as Hewlett Packard 

13 Company docket number PD-60001011Z30 , and entitled "DIS- 

14 CRETIONARY DOTTING FOR ARTIFACT CONTROL IN INCREMENTAL 

15 PRINTING'' — and subsequently assigned utility-patent ap- 

16 plication serial 08/ , , and issued as U. S. Patent 

17 6, , . Other such documents are in the names of 

18 Garcia-Reyero et al . , and identified as Hewlett Packard 

19 Company docket number PD-60990037Z23 , and entitled "IM- 

20 PROVEMENTS IN AUTOMATED AND SEMIAUTOMATED PRINTMASK GENER- 

21 AT I ON FOR INCREMENTAL PRINTING", and op cit. therein 

22 and subsequently assigned utility-patent application seri- 

23 al 09/ , , and issued as U. S. Patent 6, , . 

24 Another related document, filed somewhat later, is in the 

25 names of Gil et al . , and identified as Hewlett Packard 

26 Company docket PD-60003198Z33 , and entitled u 



27 
28 



29 " — and subsequently assigned utility-patent 

30 application serial 09/ , , and issued as U. S. Pat- 

31 ent 6, , . 

32 Also related, coowned and wholly incorporated by ref- 

33 erence herein but filed earlier are U. S. utility-patent 

34 applications serial 08/960,766 of Bockman et al . , relating 
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1 to use of lookup tables in error diffusion, and serial 

2 09/384,735 of Askeland, proposing "very-high-ratio mixed 

3 resolution", and 09/184,577 also of Askeland, teaching 

4 random selection of colorimetrically equivalent superpix- 

5 els; and also issued U. S. 4, , of Lin introducing 

6 blue-noise characteristics in halftoning. 
7 

8 
9 

10 FIELD OF THE INVENTION 
11 

12 This invention relates generally to machines and 

13 procedures for incremental printing of text or graphics on 

14 printing media such as paper, transparency stock, or other 

15 glossy media, or textiles; and more particularly to a 

16 scanning thermal -ink jet machine (whether printer, copier 

17 or facsimile receiver) and method that construct text or 

18 images — but primarily high-quality photograph-like 

19 images — incrementally from individual ink spots created 

20 on a print medium, in a two-dimensional pixel array. The 

21 invention is especially valuable for very large images, 

22 and when processing speed is constrained by use of econom- 

2 3 ical off-the-shelf processors without hardware assist, 

24 i ■ e. without the aid of an application-specific inte- 

25 grated circuit ("ASIC") , but it is not limited to use in 

26 connection with such constraints. 
27 

28 
29 
30 

31 BACKGROUND OF THE INVENTION 

32 

3 3 (a) Orientation The present-day marketplace for 

34 computer printing devices is extraordinarily competitive . 
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1 Successful products, for photo-type images no longer need 

2 only produce fine-looking prints, or operate at high 

3 throughput, or be inexpensive — but now must do all 

4 three . 

5 Thus there is great commercial pressure to use mul- 

6 tiple colorimetric levels to achieve smooth gradations for 

7 reproducing continuous -tone images, and to perform high- 

8 quality photo-like rendering — by relatively computation- 

9 intensive error diffusion rather than dither masking. (As 
10 will be seen, for smooth gradations it can be particularly 

^ 11 important to employ multilevel processing in the rendition 

J3 12 stage even if the final printing stage is only binary.) 

Ig 13 The market also demands high resolution, at least to the 

rU 14 degree that the eye is able to discern this quality. 
C± 15 There is also great market pressure for very high 

~ s 16 processing speed, and this requirement is compounded when 

O 17 the apparatus is to print very large images — which of 

tT 18 course entail processing extremely high quantities of da- 

19 ta. At the same time, however, there is intense economic 

O 

Q 20 pressure to use only commercial off-the-shelf electronic 

21 processors, avoiding the cost of an ASIC to carry the er- 

2 2 ror-dif fusion burden. 

2 3 Accordingly these market conditions present a formi- 

24 dable challenge to the limitations of the technology. For 

25 example, in the case of Inkjet products associated with 

26 the present invention, for each printing-element array 

27 (printhead, or pen) it is desired to control printing of 

28 up to two dots in each pixel of a 24-by-24 dot/mm (600 
2 9 dpi) grid, or up to one dot in each pixel of a 48-by-24 
30 dot/mm (1200-by-600 dpi), in images of poster size. 

31 

32 (b) Previous efforts — Earlier generations of large- 

33 format products, e. a. of the Hewlett-Packard Company, 

34 approached these seemingly conflicting goals by using 
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1 matrix-based binary printing, and performed the rendering 

2 and halftoning at a resolution lower than the final print- 

3 ing resolution — followed by some algorithm to artifi- 

4 daily increase the resolution when printing the image. 

5 Combining dithering and single-level halftoning im- 

6 posed distinct limits to the image quality, and these are 

7 not acceptable in the present advanced generation of these 

8 devices. In addition, for lower-quality printmodes ren- 

9 dering was performed at lower resolution and then a method 

10 of pixel replication was used to print the lower-resolu- 

11 tion images at a higher printing resolution a very fast 

12 technique. 

13 Image-quality defects, however, included patterning 

14 in area fills due to dithering, and objectionable arti- 

15 facts arising from the replication. (Close inspection 

16 would reveal that 24 dot/mm pixels were identical across 

17 pixel groupings.) Naturally the method is inflexible in 

18 that the total number of drops printed in a certain area 

19 is the number of pixels set to one ("1") in the rendered 

20 image, times the scaling factor. 

21 Also known are various other devices and systems in- 

22 volving use of smaller pixel structures. The first above- 

23 mentioned Askeland document, for example, substitutes sev- 

24 eral extremely asymmetrical small pixels for each square 

25 standard-size pixel to produce very fine actual (not simu- 

26 lated) horizontal resolution) . Other artisans have pro- 

27 posed insertion of a very localized finer-resolution data 

28 grid ( e. a. for antialiasing) . As far as the present 

29 inventors are aware, no such prior technique was for the 

30 purpose — or had the effect — of expanding a rendering 

31 resolution into a simulated final printing resolution 

32 throughout an image. 
33 
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1 (c) Conclusion Former configurations produced 

2 strikingly attractive printouts at modest cost and thus 

3 were successful within the level of development of the 

4 market then prevalent, but cannot satisfy the more-strin- 

5 gent current market demands outlined above. Thus impor- 

6 tant aspects of the technology used in the field of the 

7 invention remain amenable to useful refinement. 
8 

9 
10 

^ 11 SUMMARY OF THE DISCLOSURE 

y§ 12 

13 The present invention introduces such refinement. In 

fU 14 its preferred embodiments, the present invention has seve- 

P 15 ral aspects or facets that can be used independently, al- 

y ' 16 though they are preferably employed together to optimize 

£ ■ 

P 17 their benefits. 

r: 18 In preferred embodiments of its first major independ- 

y3 19 ent facet or aspect, the invention is a method for print- 

q 20 ing an image. The method includes the step of — for at 

21 least each colorimetric level that will be found in ren- 

22 dering the image — defining plural different superpixels. 

23 As will be understood, the levels that will be found 

24 in rendering are part of a set that is ordinarily well 

25 known in advance of beginning the online steps. They are 
2 6 design elements of the overall operating method. 

27 The invention also includes the step of generating or 

28 receiving data for the image. Another step is rendering 
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1 the image by a process that finds, for positions within 

2 the image : 

3 

4 colorimetric levels, and 

5 

6 a randomized value corresponding to substantially 

7 each found colorimetric level. 
8 

9 The method also includes the step of applying the 

10 randomized value to select a superpixel from the plural 

11 superpixels for each found colorimetric level. Yet anoth- 
y3 12 er step is printing the image using the selected superpix- 
]p 13 els - 

rij 14 

\U 15 The foregoing may represent a description or defini- 

0 1 16 tion of the first aspect or facet of the invention in its 

g 17 broadest or most general form. Even as couched in these 

ft I 8 broad terms, however, it can be seen that this facet of 

J3 19 the invention importantly advances the art. 
g 20 In particular, not only does it enable high-quality 

21 photograph- type printing by very fast error diffusion and 

22 with excellent color depth, using an off-the-shelf proces- 

23 sor without hardware assist; but in addition this facet of 

24 the invention also provides a kind of simulated 24 dot/mm 

25 (600 dpi) rendition out of a 12 dot/mm (300 dpi) rendi- 

26 tion process. That is to say, a close inspection of the 

27 finished printing will show that in general adjacent 24 

28 dot/mm pixels are different from one another, even though 

29 the error diffusion is performed at 12 dots/mm. Thus this 

30 aspect of the invention does not suffer from the kinds of 

31 image artifacts associated with e. a. pixel replication. 
32 

33 Although the first major aspect of the invention thus 

34 significantly advances the art, nevertheless to optimize 
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enjoyment of its benefits preferably the invention is 
practiced in conjunction with certain additional features 
or characteristics. In particular, there are two alterna- 
tive preferences as to the definition of superpixels: 

■ in one preference, the superpixels defined for each 
available colorimetric level are all colorimetrically 
equivalent; and 

n in the other preference, the superpixels defined for 
at least one colorimetric level vary in colorimetric 
value in such a way as to express that colorimet- 
ric level, on average, as a nonintegral number of 
colorant quanta. 

Another basic preference is that the rendering step 
operate in a computational space that has one dimension 
for each colorant available, plus at least one dummy 
dimension which generates the randomized value. If this 
preference is observed, then there are two alternative 
subpref erences : 

■ in one case, operation of the rendering step in the 
at least one dummy dimension includes using at least 
one least-significant bit that: 

results from the rendering step in a colorant 
dimen s i on , bu t 

is substantially decorrelated from colorimetric 
levels found by the rendering step; and 

■ in the other case, operation of the rendering step in 
the at least one dummy dimension includes deriving or 
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1 maintaining a matrix of randomized values; and the 

2 applying step includes mapping a particular location 

3 in the matrix to a particular position in the image 

4 — to choose a random value at the particular loca- 

5 tion in the matrix for selection of a superpixel to 

6 use at the particular position in the image. 
7 

8 The second of these cases is also the second main aspect 

9 of the invention, stated below. Thus preferences as to 

10 matrix maintaining will be deferred for discussion with 

11 that second aspect. 

12 
13 

14 In preferred embodiments of its second major inde- 

15 pendent facet too, the invention is a method for printing 

16 an image. Like the first, this method includes defining 

17 plural different superpixels for each available colorimet- 

18 ric level, and generating or receiving data for the image 

19 — and also printing the image using selected superpixels. 

20 This method, however, also includes steps that are 

21 different. One of these is rendering the image by a 

22 process that finds colorimetric levels for positions with- 

23 in the image. Another is deriving or maintaining a matrix 

24 of randomized values. 

25 Yet another step is mapping a particular location in 

26 the matrix to a particular position in the image. The re- 

27 suit of this step is choice of a randomized value, at the 

28 particular location in the matrix, for selection of a su- 

29 perpixel to use at the particular position in the image. 
30 

31 The foregoing may represent a description or defini- 

32 tion of the second aspect or facet of the invention in its 
3 3 broadest or most general form. Even as couched in these 
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broad terms, however, it can be seen that this facet of 
the invention importantly advances the art. 

In particular, this approach to obtaining randomized 
values for selection of superpixels is nearly free in 
terms of processing time, and quite economical in terms of 
information-storage requirements. The randomized matrix 
can be large if desired; however, it need not be very 
large . 

The reason is that the results of the random selec- 
tion implied by this matrix are further scrambled by the 
later printmasking stage. Therefore any tiling of this 
matrix can be made to contribute little to eventual pat- 
terning in the image as printed. 

Although the second major aspect of the invention 
thus significantly advances the art, nevertheless to 
optimize enjoyment of its benefits preferably the inven- 
tion is practiced in conjunction with certain additional 
features or characteristics. In particular, preferably 
the matrix is derived or corrected to possess a blue-noise 
property of the randomized values. 

Other basic preferences are that the mapping step in- 
clude interpreting : 

• ■ the value, found at each location in the matrix, as a 
pointer into a certain dimension of a table of super- 
pixels ; 

o an input or output colorimetric level, for the par- 
ticular position in the image, as a pointer into a 
certain dimension of the table of superpixels; or 

■ both — but with regard to different ( i . e . first and 
second) "certain" dimensions, respectively. 
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1 Another preference is that the mapping step include inter- 

2 preting identification of a color plane being rendered, as 

3 a pointer into a third dimension of the table of super- 

4 pixels. 

5 Yet another basic preference is that the mapping step 

6 include using the found randomized value for control of 

7 superpixels in all color planes. Still another is that 

8 the matrix include a set of smaller matrices, each of 

9 which contains randomized numbers corresponding to avail - 

10 able superpixels; and that successive ones of the smaller 

11 matrices be progressively stepped across the larger, 

12 first-mentioned matrix. 

13 In this latter case, a number of subpref erences (not 

14 necessarily all mutually compatible) arise, namely that: 

15 

16 ■ the stepped smaller matrices also be tiled across the 

17 larger matrix and wrapped around at an edge of the 

18 larger matrix; 
19 

20 ■ the smaller matrices all be substantially identical; 
21 

22 n the smaller matrices include plural different inter- 

23 leaved arrays (in which case it is also preferred 

24 that the plural different arrays be different sizes) ; 

25 and 
26 

27 ■ the smaller matrices be one-dimensional matrices. 
28 

29 Another basic preference as to the second facet of 

30 the invention is that the superpixels defined for at least 

31 one colorimetric level vary in colorimetric value so as to 

32 express that colorimetric level, on average, as a noninte- 

33 gral number of colorant quanta. (As will be seen from 

34 earlier discussion, however, an alternative preference is 
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1 that the superpixels have substantially the same 

2 colorimetric value.) 
3 

4 

5 In preferred embodiments of its third major independ- 

6 ent facet or aspect, the invention is a method for print- 

7 ing an image. Like the first two aspects, this method 

8 includes defining plural different superpixels for each 

9 available colorimetric level, and generating or receiving 

10 data for the image — and also printing the image using 

11 selected superpixels. 

12 Additionally included is the step of rendering the 

13 image by a process that finds colorimetric levels for 

14 positions within the image. 

15 The method further includes the step of selecting a 

16 superpixel from the plural superpixels for the found col- 

17 orimetric level- Yet further included in the method is 

18 the step of controlling the defining or selecting step, or 

19 both, to impart a blue-noise property to the selected su- 

20 perpixels — considered as an aggregate. 

21 The method also includes the step of printing the im- 

22 age using the selected superpixels. The foregoing may 

23 represent a description or definition of the third aspect 

24 or facet of the invention in its broadest or most general 

25 form. Even as couched in these broad terms, however, it 

26 can be seen that this facet of the invention importantly 

27 advances the art. 

28 In particular, this facet of the invention is 

29 particularly noteworthy in that it provides an extraordi- 

30 narily sophisticated solution to a subtle but important 

31 problem. This problem takes the visible form of distinct- 

32 ly different kinds of graininess, or clumping tendency, at 

33 different levels of colorant saturation. 
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1 In particular, randomness or so-called u noise" that 

2 is generated in ED when operating the invention near the 

3 error threshold values, is commonly white noise — i . e . , 

4 roughly flat in spectral distribution. (The reason is 

5 that the "error" being diffused is substantially zero, so 

6 that the color "signal" consists of values from a control- 

7 ling random number generator — and such values ordinarily 

8 are by definition random, i . e > white.) Noise from the 

9 error-diffusion process generally, however, is representa- 

10 tively blue noise. 

11 Thus this third facet of the invention strongly fa- 

12 cilitates equalization of the graininess property for dif- 

13 ferent colorimetric levels, within each color plane. The 

14 result is to thereby make images appear more uniform in 

15 esthetic quality. 
16 

17 Although the third major aspect of the invention thus 

18 significantly advances the art, nevertheless to optimize 

19 enjoyment of its benefits preferably the invention is 

20 practiced in conjunction with certain additional features 

21 or characteristics. In particular, preferably the defin- 

22 ing step includes screening the superpixels for spatial - 

23 frequency characteristics. 

24 Thereby spatial frequencies, other than information 

25 in the image, appear substantially consistent in the 

26 printed image. The above phrase "other than information 

27 in the image" is discussed at the end of the detailed- 

28 description section of this document. (From the preceding 

29 discussion of the third main facet of the invention, it 

30 can be appreciated that a blue-noise characteristic in the 

31 process of selecting superpixels is desirable; however, it 

32 does not fully guarantee that the content of the superpix- 

33 els themselves will follow a blue-noise characteristic.) 

34 When this preference is observed, it is particularly 
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beneficial that the screening include spatial Fourier 
analysis . 

Another preference, noted for the main aspects of the 
invention discussed above, is that the superpixels defined 
for at least one colorimetric level vary in color imetric 
value so as to express that colorimetric level, on aver- 
age, as a nonintegral number of colorant quanta. In this 
way the superpixel approach to developing 24 dot/mm ap- 
pearance is in essence exploited to provide finer grada- 
tions in colorimetric level as invoked by input level 
variations throughout the image. 

In preferred embodiments of its fourth major indepen- 
dent facet or aspect, the present invention is apparatus 
for printing an image. This apparatus includes some means 
for defining plural different superpixels for each avail- 
able colorimetric level . For purposes of breadth and gen- 
erality in discussing the invention, these means will be 
called simply the "defining means". 

The apparatus also comprises some means for generat- 
ing or receiving data for the image. Again for general- 
ity and breadth, these will be called the "data means". 

In addition the apparatus includes some means for 
rendering the image by a process that finds colorimetric 
levels for positions within the image. These, again for 
like reasons, will be called the "rendering means". 

Further included are some means for generating or 
receiving a randomized value for each of the positions 
within the image. These may be called the "random-value 



The apparatus also includes "applying means" for 
applying the randomized value, in common for all color 
planes, to select for each color plane a respective super- 
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1 pixel from the plural superpixels for the found colorimet- 

2 ric level. Additionally included are "printing means" for 

3 printing the image using the selected superpixels. 
4 

5 The foregoing may represent a description or defini- 

6 tion of the fourth aspect or facet of the invention in its 

7 broadest or most general form. Even as couched in these 

8 broad terms, however, it can be seen that this facet of 

9 the invention importantly advances the art. 

10 In particular, application of a common randomized 

11 value for superpixel control in all control planes pro- 

12 vides certain of the important benefits of plane -dependent 
*jL 5 13 error diffusion. The cost of actual plane -dependent ope- 
ra 14 ration, however, in terms of storage or processing capa- 

2 15 bility/time, is far higher than the common-value technique 

16 of the present invention. 
□ 17 

rf 18 Although the fourth major aspect of the invention 

19 thus significantly advances the art, nevertheless to 

20 optimize enjoyment of its benefits preferably the inven- 

21 tion is practiced in conjunction with certain additional 
2 2 features or characteristics. In particular, preferably 

23 the applying means include means for employing a rando- 

24 mi zed value which corresponds to a compatible set of 

25 superpixels for different color planes. 

26 If this preference is followed, then further prefera- 

27 bly the compatible set of superpixels includes coordinated 

28 placement of colorant quantity in the different color 
2 9 planes to achieve a certain image-quality objective. 

30 Still further if this subpref erence is observed then pref- 

31 erably the coordinated placement includes elimination of 

32 substantially all drop-on-drop placement across planes, 

33 within highlight regions of the image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 




Fi rr 1 i ^ a v^t-v crpnpral flow diaorram conrDarincr con — 






vpnfi onal binarv half tonina with the multilevel , superpix- 
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el half tonina of the oresent invention; 
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Fig. 2 is a diagram showing three mappings used to 
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locate a superpixel table entry — and thereby a particu- 




29 


lar superpixel — in matrix-based random selection of 




30 


superpixels according to certain preferred embodiments of 




31 


the invention, particularly employing a two-dimensional 
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(2D) matrix; 
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Fig. 3 is a diagram of compatible superpixels for use 
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in the several color planes of an image/ for minimizing 
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conflicts across planes in highlight regions of the image; 
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Fig. 4 is a reproduction of an automatically genera- 
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ted two-dimensional (2D) FFT Fourier-analysis plot for 




6 


level 1 of a two -by- two superpixel ; 
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Fig. 5 is a like 2D FFT reproduction for level 2 of 
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the Fig. 4 superpixel; 
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Fig. 6 is a like reproduction illustrating detection 
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of asymmetry with the 2D FFT; 
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Ficr 7 is a araoh of outout from a modified radial 






<;ncir«friiTn fMRS^ derived from the 2D FFT of FiciS . 4 and 5 ; 
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Fig. 8 is a diagram of the square-annular integration 
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Fig. 9 is a mapping diagram analogous to Fig. 2 but 
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around, instead of the 2D matrix of Ficr. 2; 
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Fig. 10 is a graph of optical density vs. number of 
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dots, for discussion of nonintegral— state linearization; 
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Fig. 11 is a diagram of superpixel random selection 
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for expanding a single dot in a 12 dot/mm grid into a non- 
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Fig. 12 is a tabulation with accompanying diagram and 
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Ficr 13 is a oersoective view of the exterior of a 
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nrintina device pmbodvi no oref erred embodiments of the 
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invention ; 
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Fig. 14 is a liice view or a scanning carriage ana me 




30 


dium-advance mechanism in the Fig. 13 device; 




31 


Fig. 15 is a highly schematic diagram of the working 




32 


system of the Fig. 13 and 14 device, particularly as used 
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to practice preferred embodiments of the third above-in- 




34 


troduced aspect of the invention; and 
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1 Fig. 16 is a flow chart showing operation of the Fig. 

2 13 and 14 device (but also including some off-line steps 

3 of preparation) , particularly as used to practice the 

4 first, second and fourth aspects of the invention. 
5 

6 
7 
8 

9 DETAILED DESCRIPTION 

10 OF THE PREFERRED EMBODIMENTS 
11 

12 

13 1. MAPPING SPATIAL RESOLUTION TO COLORIMETRIC RESOLUTION 
14 

15 Actual spatial resolution needed for photograph -like 

16 reproduction is low (6 to 8 dot/mm, 150 to 200 dpi) , pro- 

17 vided that the number of possible color levels is high 

18 enough. The low resolution requirement applies particu- 

19 larly in large-format images as these are most commonly 

20 viewed at relatively greater distances — and also if the 

21 above-mentioned strict identicality of adjacent pixels is 

22 avoided. Therefore actual imaging of details can be tra- 

23 ded-off for more colors to enhance smooth colorimetric 

24 gradation. 

25 This approach is pursued in the present invention. 

26 Preferred embodiments of the invention combine the bene- 

27 fits of multilevel error diffusion and fine colorimetric 

28 resolution, to virtually eliminate both patterning and 

29 color contouring. 

30 The invention, however, is applicable to systems in 

31 which the final printing stage is* actually either multi- 

32 level or binary. In other words, the multilevel ED proc- 

33 essing may be only an intermediate step and binary 
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An additional improvement was to make the superpixel 




30 


choice randomly. (Random choice of superpixels to reduce 
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banding is introduced in the previously mentioned Askeland 
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document.) Thereby the system was made much more resis- 
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tant to printer errors, and the fine texture made still 




34 


more irregular and realistic. 
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1 Therefore the invention achieves, in an extremely 

2 economical system, an excellent rich environment for re- 

3 production of continuous-tone images. While presenting a 

4 simulated fine spatial resolution it is essentially free 

5 of patterning and contouring. 

6 Randomizing the selection of superpixels, however, 

7 had two negative consequences. One was the computational 

8 overhead of generating a random number for each pixel . 

9 That overhead is large enough to eradicate the performance 

10 benefit over binary halftoning. 

11 The second was much more subtle. When halftoning a 

12 patch, or a region in an image, with a constant color sim- 

13 ilar to one of the threshold levels defined in the error- 

14 diffusion process, the output was noisy. 

15 In that case, no error is propagated and what appears 

16 is very noticeable white noise directly from the superpix- 

17 el selection. This in itself is perhaps acceptable, since 

18 noise occurs for colors intermediate between the threshold 

19 levels, too; however, the noise characteristics are dis- 

20 tinctly different. 

21 While random clumping of dots at or near ED thresh- 

22 olds has a white-noise character, the texture for interme- 

23 diate colors has more high-frequency content i . e. so- 

24 called "blue noise". Unexpectedly, this difference is 

25 readily seen and introduces an irrational -seeming fluctua- 

26 tion in overall appearance as colors change. 

2 7 Various approaches to resolving these randomization 

28 problems are taken up in turn below. They include using a 

2 9 simple random-number generator, sharing the same random- 

30 ness for all color planes, and trying to add blue-noise 

31 character to the random-number generation process. 

32 These efforts also made clear how important it is to 

33 choose a correct set of superpixels to represent a given 

34 level. This becomes increasingly more difficult with in- 
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1 creasing superpixel size — which in itself is desirable 

2 to reduce the effective resolution used in rendering — 

3 because the number of candidates for a given level grows 

4 very fast with superpixel size. 

5 A starting point is four-weight binary error diffu- 

6 sion that somewhat randomizes the distribution of error by 

7 perturbing the ED weights. Serpentine raster processing 

8 was adopted to further reduce directionality artifacts. 

9 Extension of that algorithm to multilevel representations 

10 is straightforward; lookup tables are used in the error 

11 processing to avoid the computational burden of doing com- 

12 parisons and distributing the errors arithmetically. 
13 

14 

15 3. ALGORITHM OVERVIEW 
16 

17 Here are some terms that will be used in the explana- 

18 tion that follows: 
19 

20 a original resolution resolution of the image before 

21 any scaling; 

22 

23 ° rendering resolution resolution of the image just 

24 before halftoning (this might include some scaling 

25 during the rasterization) ; 
26 

27 ■ device resolution — resolution of the image just be- 

28 fore printing (this might be different from rendering 

29 resolution if some scaling is performed after half- 

30 toning) ; and 
31 

32 ■ superpixel a mapping from the rendering to the de- 

33 vice resolution, which expands into a two-dimensional 

34 cell each of the output levels of the halftoning. 
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Conventional binary halftoning 11-15 (Fig. 1) is 
distinctly different from a multilevel halftoning 21-27 
that uses superpixels. In the binary case, CMYK contone 
data 11 (eight bits per plane) , assumed to be already 
color corrected, are scaled 12 to the device resolution. 
13. Then they are half toned 14 using error diffusion to 
obtain one bit 15 per plane at the device resolution. 

The present multilevel approach, by contrast, per- 
forms the scaling in two steps. The first uses a conven- 
tional method, bilinear scaling 22, to bring the image 21 
to the resolution 23 used for the halftoning (rendering 
resolution) . 

Next comes an ED variant 2, which generates five 

planes 25: CMYK, and "random", with m bits each where 

m is small, i . e. 2, 3 or 4 . (As to both conventional bi- 
nary technique 11-15 and the innovative multilevel method 
21-27, greater numbers of colorants are permitted. For 
instance six colorants CMYKcm including dilute cyan and 
magenta, are part of a particularly preferred embodiment.) 

The random plane, together with a predefined set of 
superpixels, will later be used to scale up to the final 
device resolution by mapping each of the levels (defined 
by m bits) to a superpixel 26. The superpixel itself can 
be assumed binary, although this is by no means a require- 
ment of the invention. That is, in both the earlier bi- 
nary halftoning and the present multilevel halftoning, the 
final output can be four binary planes 27 with the same 
resolution (K-R) . 

For a presently preferred product embodiment, and 
also for the sake of simplicity in explanation, it can be 
assumed that the final device is binary. This means that 
for the rest of the system it is irrelevant that one in- 
termediate step uses multilevel processing — except that, 
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1 as noted earlier, this is a particularly economical, rapid 

2 and effective way to process the data. 

3 If the final device supports multilevel printing, 

4 however, such printing is readily supported by providing 

5 multilevel (nonbinary) superpixels. Thus the invention is 

6 extremely versatile with regard to the final output form. 

7 Multilevel ED with random superpixels has at least 

8 three major advantages: 
9 

10 (a) Reduce processing overhead — Scaling and half- 

11 toning with error diffusion constitute most of the compu- 

12 tations, in a color pipeline according to preferred em- 

13 bodiments of the invention. By using a lower resolution 

14 in both operations, it is possible to significantly speed 

15 up the processing. 

16 In particular it was found that use of a 12 dot/mm 

17 four-level ED with superpixel output provided a 2^-fold 

18 throughput improvement over traditional 24 dot/mm binary 

19 ED (both using binary scaling to map a 60 Mbyte photo to 

20 an E -size sheet) . Final image quality was very comparable 

21 for the two methods. 
22 

23 (b) Reduce bandwidth and memory requirements Ex- 

24 pansion of the superpixels can be delayed until the last 

25 moment before printing, even on the fly with some hardware 

26 support. Even with no extra-hardware support the overhead 

27 of this expansion is small, given a fast processor. 

28 The benefit of such delay is that the size of a swath 

29 before superpixel expansion is much smaller than after ex- 

30 pansion: 12 dot/mm with four levels (two data bits per 

31 pixel) is half the size of 24 dot/mm binary. The delay 

32 therefore reduces the memory needed, the disc bandwidth 

33 requirement for directing printing from it, or network 
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1 bandwidth for printing RTL (raster transfer language) 

2 plots, if they are in this format. 
3 

4 (c) Minimize halftoning artifacts — The combination 

5 of serpentine raster processing, built-in weight random! - 

6 zation and random superpixels significantly reduces most 

7 of the worm-like artifacts that standard ED techniques 

8 produce in highlight areas. Also, random selection of a 

9 set of compatible superpixels across color planes for each 

10 pixel is preferable to independent selection of superpix- 

11 els independently for each color plane. 

12 Selection of compatible sets reduces problems of 

13 interactions of different planes. In particular, this 

14 strategy can be exploited to reduce graininess by avoiding 

15 placement of drops in one plane on top of drops in another 

16 plane in light tone regions. 
17 

18 On the other hand, accompanying these three advanta- 

19 ges there is a disadvantage. Because rasterization takes 

20 place at lower resolution, notwithstanding the presence of 

21 a simulated high resolution, text and line art may not ap- 
2 2 pear as "crisp" as they would if full resolution were 

2 3 used. 

24 

25 

26 4. RANDOMIZATION TECHNIQUES 
27 

28 Successful practice of preferred embodiments of the 

29 invention calls for generation of pseudorandom numbers 

30 quickly. It is also desirable that the numbers have cer- 

31 tain properties — such as limited low frequencies, which 

32 are more visible to the eye; and absence of any particular 

33 directionality, which could produce artifacts. 
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1 The overhead of random number generation is signifi- 

2 cantly reduced by using the same number for all the color 

3 planes (CMYK) . This is equivalent to adding a fifth plane 

4 <R, for "random") that determines the superpixel selection 

5 for the other four, at each level. 

6 As suggested earlier, this tactic has an interesting 

7 and very beneficial side-effect: it enables definition of 

8 a family of superpixels, one for each plane — that are 

9 likely to be printed together. The superpixels in each 

10 set can be designed to minimize interactions between color 

11 planes, so that some plane -dependent benefits are obtained 

12 even though the halftoning is nominally plane independent. 
13 

14 (a) Standard random number generator (RNG) The in- 

15 ventors experimented with several techniques for random 

16 number generation. One was to use an off-the-shelf libra- 

17 ry call, M lrand48", which provides a uniformly distributed 

18 sequence of pseudorandom numbers . 

19 This module uses a linear congruential algorithm with 

20 forty-eight-bit integer arithmetic. It gives excellent 

21 quality, with no visible artifacts due to correlation 

22 across lines with an important exception, mentioned 

23 earlier: 

24 When halftoning patches with colors near a halftoning 

25 threshold, the error itself is zero. What is seen, then, 

26 is a pattern determined exclusively by the spectral prop- 

27 erties of the random-number sequence. 

28 In the present case that sequence is essentially 

29 white noise, which includes a relatively large low-fre- 

30 quency content, not very pleasant to the eye. This appea- 

31 ranee is different from the basic texture of error diffu- 

32 sion, which is a blue-noise characteristic. 

33 The white-noise characteristic is particularly annoy- 

34 ing in smooth gradients crossing a halftoning threshold. 
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1 The reason is that in traversal of the threshold level, 

2 the noise texture of the printed image changes from blue 

3 to white and then back again to blue. 

4 The transition is thereby made very visible. It 

5 would be possible to apply a high-pass filter to the ran- 

6 dom-number sequence, but after preliminary effort this so- 

7 lution appeared too expensive. 

8 Another problem was that the off-the-shelf RNG was 

9 too slow, losing all the benefits of lower-resolution ren- 

10 dering. A related alternative was to reduce this overhead 

11 by precomputing a random sequence and reusing it across 

12 lines, but then correlated artifacts began to appear. The 

13 off-the-shelf RNG was then abandoned, and work started on 

14 a custom RNG. 
15 

16 (b) Error-diffusion RNG — Preferred embodiments of 

17 the invention need only a few random bits (typically two) 

18 to guide the superpixel selection. It is well known that 

19 the least significant bit (LSB) of typical images carries 

20 very limited image content, and this is even more clear 

21 after applying complex scaling ( i . e. bilinear) . 

22 This fact implies that the LSB of each error value 

23 propagated during the ED halftoning of images is nearly 

24 uncor related with the original image and thus provides a 

25 reasonable degree of randomness. In other words, the 

26 proposition is to use part of the ED error itself as the 

27 random bits. 

28 The favorable properties of the LSB can be enhanced 

29 by performing an exclusive-or (XOR) function on the error 

30 LSBs across the four color planes, and initializing the 

31 error buffer with small random values instead of zeroes. 

32 In practice the cost of doing the XOR and masking the LSB 

33 was negligible — no extra memory-access call was needed, 
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1 and the quality of the output for images was very nearly 

2 as good as with the off-the-shelf RNG. 

3 Unfortunately, when applied to solid patches the re- 

4 suits were not as good as for images. In particular, when 

5 the solid-patch color was exactly the same as one of the 

6 halftoning threshold levels — so that no error was to be 

7 propagated — some correlated artifacts could appear. 

8 This problem could be easily fixed by monitoring when 

9 the error was consistently zero, and in that case fall 

10 back to the off-the-shelf RNG. The extra comparisons 

11 would carry some penalty, and some peculiar cases would 

12 operate slowly; but overall this technique would be faster 

13 than the first method. 

14 Another problem with the ED RNG was the same as dis- 

15 cussed above for the standard RNG, relating to white-noise 

16 character of the output when operating near an ED thresh- 

17 old. The cost of dealing with the noise characteristic 

18 here too was deemed excessive. 
19 

20 (c) Matrix-based RNG — One way to impart a blue- 

21 noise property to a sequence of random numbers is to pre- 

22 compute a matrix of values with that property. One way to 

23 begin is with a blue-noise dithering matrix (introduced by 

24 the previously mentioned document of Lin) . 

25 Levels in that matrix can be collapsed until what 

26 remains are all entries ranging from unity through the 

27 number of superpixels, and roughly the same number of en- 

28 tries per level. That collapsed matrix 162 (Fig. 2) can 

29 be used to generate pseudorandom superpixels 166D' . 

30 Given a pixel 171 with coordinates x and y we index 

31 (172r for rows and 172c for columns) inside that matrix 

32 with the coordinates relative to the matrix, obtaining a 

33 random entry 173. The superpixel 166D' that will be 

34 inserted in position for a particular color plane 91-94 
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(Fig. 3) is obtained by entering a superpixel selection 
table 163 with: 

■ that random entry 173 as an abscissa pointer 174, 

" the intensity level 171 as an ordinate pointer 179, 
and 

a if desired, the plane being rendered as plane pointer 
(not shown) . 

The last-mentioned choice is actually not necessary in 
preferred embodiments, since the same random entry advan- 
tageously is used for all planes to gain the plane-depen- 
dent properties noted earlier. 

This process is somewhat similar to now-conventional 

dithering with a blue-noise matrix with the important 

difference that no threshold operation is required at this 
point. In addition, the size of the superpixel tables 163 
is kept small because the range of intensity levels 171, 
179 has already been heavily reduced by error diffusion. 

Therefore this operation can be performed very quick- 
ly and without significant memory overhead. Furthermore 
this methodology avoids the previously mentioned difficul- 
ties of mismatched noise characteristics. 

Using this method in ED of a solid patch that is 
exactly the color of an ED threshold, however, does pro- 
duce a repeated pattern. In practice such a repetitive 
pattern can be hidden by using a large enough random ma- 
trix 162 — and a matrix of two hundred fifty-six values 
has been found a reasonable size for this purpose. 

(d) Randomization by ID arrays — An alternative is a 
scheme using a one-dimensional array or so-called "vector" 
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1 41 (Fig. 9) , or several such arrays of different lengths, 

2 with wrap-around. In a single-array case, the array 41 

3 has length V x and is filled with random numbers from one 

4 through the maximum number of equivalent superpixels. 

5 Typically random numbers chosen for the array have a 

6 high-frequency spectral characteristic, in order to reduce 

7 graininess. The index into this array is obtained by til- 

8 ing (Fig. 9) the page 162' with the array, but wrapping 

9 the array sequence around 42 at the end of the line (page 

10 width is W x ) . In the illustration what is tiled is the 

11 array sequence rather than any individual array, since an 

12 integral number of arrays is spaced to fit into the page 

13 width as shown. 

14 In practice, the index into the array is computed 

15 from the input pixel coordinates (X/Y> by counting the 

16 number of pixels from the top left corner of the page to 

17 this pixel (while traversing the page left-to-right and 

18 top- to-bottom) , and calculating the relative offset of 

19 this value inside the array ( i . e. , (yW x +x) mod V x ) . The 

20 random number 173, 174 in the array 162' corresponding to 

21 that index, together with the input level 179, is used to 

22 select the superpixel cell 91, 167A from a lookup table 

23 163. Typically V x and W x are chosen relatively prime of 

24 each other so that the pattern does not repeat across many 

25 lines. 

26 This scheme can be generalized by using multiple ID 

27 arrays ( i . e. , N arrays) , possibly of different sizes, and 

28 using array i, for rows of the input image 1, i+N, i+2N, 

29 ... wrapping this array around within this subset of 

30 rows. (Other, less-systematic stepping is also feasible 

31 and may be preferable.) This interleaving makes the pat- 

32 tern even less repeatable across lines. 
33 

34 
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5. SUPERPIXEL SELECTION 

Although the' random matrix has a blue-noise property, 
it does not follow that this property must be preserved 
after expansion of the superpixels selected using that ma- 
trix. It is the expanded superpixels that the end-user 
sees. This issue will be taken up shortly, and related 
comments appear at the end of this detailed description . 

It would be possible to provide different superpixels 
for each intensity level ( i . e. four, if two data bits are 
in use) , and for each random choice (again four is typi- 
cally enough) . This implies designing 4 3 = 64 matrices of 
two-by-two elements ( i . e. to double the resolution) . 

A way to simplify the problem is rotation of the 
roles of the planes for each random choice: this reduces 
by a factor of four the number of superpixels to be selec- 
ted. Also whenever possible it is desirable to use the 
stacking property that ensures monotonic behavior: a su- 
perpixel of a higher level includes a superpixel of lower 
level for the same plane and random choice. 

Design of a compatible-superpixel set is advanta- 
geously guided by these goals: 

(a) Keep blue-noise quality after expansion The 

matrix-based RNG described above is best used to ensure 
blue-noise characteristics. Using Fourier-analysis tech- 
niques described below, it is provided that these prop- 
erties are preserved in using a set of superpixels. 

(b) Reduce asymmetric artifacts It is possible for 

individual superpixels to emphasize particular directions, 
for example the horizontal. Such tendencies individually 
are acceptable. 
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column 91-94 of superpixels, for control of all the planes 
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in a coordinated way. 
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highlights . 




(e) Minimize the firina frecruencv of the pens — A 




31 


dense horizontal line, if it must be implemented all with- 




32 


in a single pass, can require a higher pen firing frequen- 




33 


cy that a dense vertical or diagonal line. Therefore try- 
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1 ing to avoid dense horizontal patterns in superpixels is 

2 helpful . 

3 
4 
5 

6 6. FOURIER ANALYSIS OF SUPERPIXELS 
7 

8 Superpixel selection is advantageously based upon the 

9 goals and principles introduced above. The process of se- 

10 lecting superpixels, however, is not yet fully automated. 

11 Currently as a starting point the technique uses a 

12 lower-rank superpixel that performs reasonably well, and 
jr: 13 adds extra drops one by one in each random set. For each 
r Z 14 one added, a Fourier analysis is performed to ensure that 
M 15 the design goals are reasonably met. 

^ 16 If not, then another candidate is chosen — based 

S 17 somewhat on intuition — and the analysis rerun. Although 

18 the process seems labor intensive, in most cases the su- 

% 19 perpixels are not bigger than four-by-four ( i . e . mapping 

p 20 12 to 24 dot/mm) and the number of possible candidates 

21 does not explode. 

22 To perform the Fourier analysis the original random 

23 matrix is expanded into n matrices, where n is the number 

24 of intensity levels. Each one is the result of inserting 

25 the superpixels for that particular level using that ran- 

26 dom entry; this is repeated for each plane if different 

27 behavior across planes is expected. 

28 (Expansion for each level makes practical sense as 

29 that can happen in an area fill. Such regions do occur, 

30 even though a primary objective is printing of photo-like 

31 images . ) 

32 For example, if the random matrix has 256 by 256 en- 

33 tries and the system is to use two-by-two binary superpix- 

34 els with four input levels, then four binary matrices of 
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1 


512 by 512 will be generated. Then a 2D-FFT (magnitude) 


• 


2 


of each of these four matrices is computed. 




3 


As an example of this, a display of such an FFT level 




4 


1 (one drop per superpixel) shows a reasonable blue— noise 




5 


spectrum. It has little low- frequency content 31 (Fig. 4) 
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and reasonable hi crh— freemen cv content (the rest of the 
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image , including some peripheral energy clusters 33) . 
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extended vertical structure 34 (Fia. 6) , with larae lobes 


i s_ 
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36 at top and bottom, linked to the central, low-frequency 


•z? - 
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<™»on oon r ra r i on 
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A better way to see the blue-noise property, however, 




18 


is by examining a modified radial spectrum (MRS) derived 


5 E 


1 Q 


from fhp 2D— FFT orpviouslv comouted. This is similar to 




on 


rarfi » i l w avpraapH oowf*r soectra described in Dioital Half— 
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toning by Robert Ulichney — but instead of using the pow- 
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er spectrum this method integrates the magnitude of the 






2D-FFT between concentric scruares 38 (Fia.8) , rather than 
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circles . 
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This method reflects better the limitation of the 






hum^n t*v£* to c*e*e diaaonal lines. ComDutina the MRS of the 
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that low- frequency content 37 is small, and growth 37' is 




29 


steep for higher frequencies for both levels. It has been 




30 


checked empirically that superpixels with higher MRS in 




31 


the low frequencies are less visually pleasing. 




32 


These modifications to standard halftoning algorithms 




33 


permit reduction of system requirements (memory, process- 




34 


ing power, and storage) without decreasing the effective 
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1 quality of printed images. This is enabled by multilevel 

2 techniques that allow rendition at lower resolution, to- 

3 gether with randomization techniques that reduce artifacts 

4 of doing so. An area of compromise is in text and line- 

5 art input, where high spatial resolution is required. 
6 

7 

8 7. LINEARIZATION WITH NONINTEGRAL STATES 
9 

10 In thermal Inkjet devices the image is obtained by 

11 firing an integral number of drops into a pixel grid. 

12 Multidrop devices can fire N drops in every cell of the 

13 grid, with N an integer and N > 1 ( i . e . 1,2,3, . . . ) . 

14 The halftoning process determines the number of dots that 

15 correspond to each cell of the grid. 

16 Once the pen architecture is closed, the drop size of 

17 the pen is fixed — establishing a discrete relationship 

18 between the amount of ink per pixel and the number of 

19 drops. This relationship in combination with the media 

20 ink-absorption characteristic ("drop gain") determines a 

21 finite set of pairs in the L* curve (Fig. 10) or, more 

22 precisely, optical -density curve. 

23 There are situations, however, in which it may be de- 

24 sirable to deposit an amount of ink per pixel that doesn't 

25 match well to any integral number of dots. Such a re- 

26 quirement may arise from considerations of ink limiting, 
2 7 or of gradation smoothness, or other factors. 

28 Thus for instance it may be desired to hold the maxi- 

29 mum amount of liquid 4 9 per pixel to 2H dots (about 33 

30 picoliters) rather than settling for any integral break- 

31 point 47, 48, . . .in the number of dots. In ink-limit- 

32 ing terms, the effect on cockle for a given print medium 

33 may be importantly affected, and the resultant inking may 
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1 be extremely useful notwithstanding the accompanying 

2 effect on optical density. 

3 A particularly useful application of this technique 

4 is to obtain intermediate values 51 (Fig. 11) , 52 (Fig. 

5 12) in the linearization of output density 171, 155-158 to 

6 device states 165-168. Although the superpixeling is used 

7 primarily to print at higher resolution than the halfton- 

8 ing resolution, it can also provide intermediate values 

9 along the dot axis i . e . on average a nonintegral num- 

10 ber of dots . 

11 
12 

13 8. MECHANICAL AND PROGRAM/METHOD FEATURES 
14 

15 The invention is amenable to implementation in a 

16 great variety of products. It can be embodied in a prin- 

17 ter/plotter that includes a main case 1 (Fig. 13) with a 

18 window 2, and a left-hand pod 3 which encloses one end of 

19 the chassis. Within that enclosure are carriage-support 

20 and -drive mechanics and one end of the printing-medium 

21 advance mechanism, as well as a pen-refill station with 

22 supplemental ink cartridges. 

23 The printer/plotter also includes a printing -medium 

24 roll cover 4, and a receiving bin 5 for lengths or sheets 

25 of printing medium on which images have been formed, and 

26 which have been ejected from the machine. A bottom brace 
2 7 and storage shelf 6 spans the legs which support the two 

28 ends of the case 1 . 

29 Just above the print-medium cover 4 is an entry slot 

30 7 for receipt of continuous lengths of printing medium 4 . 

31 Also included are a lever 8 for control of the gripping of 

32 the print medium by the machine. 

33 A front-panel display 211 and controls 212 are moun- 

34 ted in the skin of the right-hand pod 213. That pod en- 
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1 closes the right end of the carriage mechanics and of the 

2 medium advance mechanism, and also a printhead cleaning 

3 station. Near the bottom of the right-hand pod for readi- 

4 est access is a standby switch 214. 

5 Within the case 1 and pods 3, 213 a cylindrical plat- 

6 en 241 (Fig. 15) — driven by a motor 242, worm and worm 

7 gear (not shown) under control of signals from a digital 

8 electronic processor 71 rotates to drive sheets or 

9 lengths of printing medium 4A in a medium- advance direc- 

10 tion. Print medium 4A is thereby drawn out of the print- 

11 medium roll cover 4. 

12 Meanwhile a pen-holding carriage assembly 220 (Figs. 

13 14 and 15) carries several pens 223-226 (Fig. 14) back and 

14 forth across the printing medium, along a scanning track 

15 — perpendicular to the medium- advance direction — while 

16 the pens eject ink. For simplicity's sake, only four pens 

17 are illustrated; however, as is well known a printer may 

18 have six pens or more, to hold different colors or dif- 

19 ferent dilutions of the same colors as in the more- typical 

20 four pens. The medium 4A thus receives inkdrops for for- 

21 mation of a desired image, and is ejected into the print- 

22 medium bin 5. 
23 

24 A very finely graduated encoder strip 233, 236 (Fig. 

25 15) is extended taut along the scanning path of the car- 

26 riage assembly 220 and read by another, very small auto- 

27 matic optoelectronic sensor 237 to provide position and 

28 speed information 237B for the microprocessor. One advan- 

29 tageous location for the encoder strip is shown in several 

30 of the earlier cross-referenced patent documents at 236, 

31 immediately behind the pens. 

32 A currently preferred position for the encoder strip 

33 33 (Fig. 14) , however, is near the rear of the pen -car - 

34 riage tray — remote from the space into which a user's 
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1 hands are inserted for servicing of the pen refill car- 

2 tridges. For either position, the sensor 237 is disposed 

3 with its optical beam passing through orifices or trans- 

4 parent portions of a scale formed in the strip. 

5 The pen-carriage assembly 220, 220' (Fig. 15) is 

6 driven in reciprocation by a motor 231 along dual 

7 support and guide rails 232, 234 — through the intermedi- 

8 ary of a drive belt 235. The motor 231 is under the con- 

9 trol of signals from digital processors 71. 

10 Naturally the pen-carriage assembly includes a for- 

11 ward bay structure 222 for pens — preferably at least 
y3 12 four pens 223-226 holding ink of four different colors 

13 respectively. Most typically the inks are yellow in the 

14 leftmost pen 223, then cyan 224, magenta 225 and black 

15 226. As a practical matter, chromatic-color and black 

16 pens may be in a single printer, either in a common car- 

17 riage or plural carriages. 

18 Also included in the pen-carriage assembly 220, 220' 

19 is a rear tray 221 carrying various electronics. Figs. 13 

20 and 14 most specifically represent a system such as the 

21 Hewlett Packard printer /plotter model "DesignJet 2000CP" , 

22 which does not include the present invention. These 

23 drawings, however, also illustrate certain embodiments of 

24 the invention, and — with certain detailed differences 

25 mentioned below — a printer/plotter that includes pre- 

26 f erred embodiments of the invention. 
27 

28 Before further discussion of details in the block 

29 diagrammatic showing of Fig. 15, a general orientation to 

30 that drawing may be helpful. This diagram particularly 

31 represents preferred embodiments of the previously dis- 

32 cussed fourth aspect of the invention. 

33 Conventional portions of the apparatus appear as ele- 

34 ments 70 through 78 at the left end of Fig. 15, and also 
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1 the printing stage 220, 220' , 241, 242, 237. Also gene- 

2 rally conventional are related signals 66, 237B, 220B, 

3 220' B, 231A, 242A, and the associated output/printmask 

4 stage 88 at the far right end of the diagram. 

5 Features particularly related to the fourth aspect of 

6 the invention appear in the central region as elements 81 

7 through 87 . Given the statements of function and the dia- 

8 grams presented in this document, an experienced program- 

9 mer of ordinary skill in this field can prepare suitable 
10 programs for operating all the circuits. 

11 

12 The pen-carriage assembly is represented separately 

13 at 220 when traveling to the left 216 while discharging 

14 ink 218, and at 220' when traveling to the right 217 while 

15 discharging ink 219. It will be understood that both 220 

16 and 220' represent the same pen carriage. 

17 The previously mentioned digital processor 71 pro- 

18 vides control signals 220B, 220' B to fire the pens with 

19 correct timing, coordinated with platen drive control 

20 signals 242A to the platen motor 242, and carriage drive 

21 control signals 231A to the carriage drive motor 231. The 

22 processor 71 develops these carriage drive signals 231A 

23 based partly upon information about the carriage speed and 

24 position derived from the encoder signals 237B provided by 

25 the encoder 237. 

26 (In the block diagram all illustrated signals are 

2 7 flowing from left to right except the information 237B fed 

28 back from the sensor — as indicated by the associated 

29 leftward arrow.) The codestrip 233, 236 thus enables for- 

30 mation of color inkdrops at ultrahigh precision during 

31 scanning of the carriage assembly 220 in each direction — 

32 i . a. , either left to right (forward 220') or right to 

33 left (back 220) . 



Antonio Lain et al. / August 19, 2000 



37 



P. Lippmaa / PD-60002639 xHPZ-31 






1 


New image data 70 are received 191 into an image-pro- 




2 


cessing stage 73, which may conventionally include a con- 




3 


trast and color adjustment or correction module 72, and an 




4 


error-diffusion (ED) rendition module 76 which operates at 




5 


relatively low resolution e. cr. 12 dots/mm. The color 




6 


module 72 provides paired pixel -position and pixel -color 




7 


data points to the ED module 76. 




3 


In addition the oixel— dosi tion data oass to a module 




9 


81 that generates or receives random numbers for the ope- 




10 


ration of the oresent invention. Preferablv the random 


Q 


11 


numbers are preassembled into a matrix 84 as described 




1 2 




s 


13 


One of those numbers when needed is read out at 193 


n 1 

JF 


14 


by two pointers 82, 83, which respectively respond to the 




1 5 


output tone value 77 found by the error— diffusion block 




16 


76, and the pixel— position information 75 provided from 


i'" '5 


17 


the color module 72 also as earlier exolained. A third 




18 


pointer, namely identity of a color plane being rendered, 




19 


may be employed as well; however, this third pointer is 


P*5 


20 


not shown here, as it can be unnecessary if the system 




21 


will use suoeroixel sets that are interolane coordinated. 






In addition to the preassembled random— number matrix 




23 


84, advantageously the apparatus has some means 85 defin- 




24 


inn aroiiDs of suoeroixels a seoarate crrouo 91C 




25 


94K for each tone value 77, 192 output by the ED module 




26 


76. Each superpixel has a hiaher resolution, e. a. 24 




27 


dots/mm than the ED resolution e. a. 12 dots/mm. Each 




28 


superpixel group typically includes several choices, here 




^ y 


rour, xor eacn coioianu, tnus tnere niciy ue luur ^yaii v^huj. 




30 


ces 91C, 92C, 93C, 94C for the particular tone level 192. 




31 


Thus if the color 192 to be printed contains cyan, 




32 


the random number 193 read out from the matrix 84 is used 




33 


by a number -applying module 86 to select for printing just 




34 


one superpixel choice 94C for example. At the same time 
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1 if the target color 192 also contains another sub tractive 

2 primary, yellow for example, then a superpixel 94Y (con- 

3 tinuing the same example) for that specific colorant is 

4 automatically selected from a prearranged compatible set 

5 of superpixels 94C-94K which includes the chosen su- 

6 perpixel 94C. 

7 In Fig. 15 the superpixels are shown in a rank-and- 

8 file arrangement. For the given input tone 192, the 

9 choices of a specific colorant appear as the ranks; the 

10 compatible set of which each choice is a part appear as 

11 files. In the example above, the choice 94C was in the 
Cf 12 cyan rank, and the compatible set was the file 94C-94K. 

j» 13 Similarly if operation of the random- number applying 

14 means 86 instead produces a different cyan choice 92C 

C± 15 (from the cyan rank of course — but now implicating a 

01 16 different file 92C-92K) , and if the target color 192 also 

O 17 contains black, then a superpixel 92K may be selected from 

S 18 the same file as the chosen cyan superpixel 92C. 

J3 19 a selected superpixel, or members of a superpixel 

p 20 set, are read out as data 194 representing one or more se- 

21 lected superpixels 87. This selected superpixel, or group 

22 of superpixels, has the higher resolution sought for use 

23 in printing — in response to the lower resolution em- 

24 ployed in the error diffusion 76. 

25 The superpixel or group of superpixels next proceeds 

26 as information 195 from the image-processing stage 73 to 

27 enter the printmasking and final -output module 88 — for 

28 specific pass and nozzle assignments, and development of 

29 control signals 220B, 231A, 220" B, 242A to drive the 

30 printing stage 220, 220', 241, 242 seen at right. 

31 Integrated circuits 71 may be distributive — being 

32 partly in the printer, partly in an associated computer, 

33 and partly in a separately packaged raster image proces- 
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# • 

1 sor. Alternatively the circuits may be primarily or whol- 

2 ly in just one or two of such devices. 

3 These circuits also may comprise a general -purpose 

4 processor (e . q. the central processor of a general -pur- 

5 pose computer) operating software such as may be held for 

6 instance in a computer hard drive, or operating firmware 

7 ( e, q. held in a ROM 70 and for distribution 66 to other 

8 components) , or both; and may comprise appl i cation -spe- 

9 cific integrated circuitry. Combinations of these may be 
10 used instead. 

11 
12 

13 In operation the system retrieves 301 (Fig. 16) its 

14 operating program appropriately — i. e . , by reading in- 

15 structions from memory in case of a firmware or software 

16 implementation, or by simply operating dedicated hardware 

17 in case of an ASIC or like implementation. Once prepared 

18 in this way, the method proceeds to the procedure 302 

19 through 325 as illustrated. 

20 Principal steps, as the drawing shows, include super- 

21 pixel definition 302, image data generation or receipt 

22 306, rendering 307-308, randomi zed-value generation 311, 

23 superpixel selection 323 using that randomized value, and 

24 final printout 325. Within the random-value block are two 

25 major alternatives: the matrix method 312 which has occu- 

26 pied major parts of the above disclosure, and the decor re- 

27 lated-LSB method 322 which as mentioned earlier appears 

28 workable but requires extra tests and workarounds due to 

29 absence of reliable numbers when error is zero. 

30 Details of the matrix method appear clearly in Fig. 

31 16, correspondingly closely to the discussions in earlier 

32 subsections of this detailed description and also to 

33 certain of the appended claims. One interesting and im- 
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1 portant point is that the system actually is characterized 

2 by three different spatial -frequency sets: 
3 

4 ■ the spatial frequencies inherent in any image, any 

5 picture 306 as such — the frequencies corresponding 

6 to elements of a picture, e . a, faces, railway 

7 trains, trees and so on — which ordinarily vary 

8 broadly over an extremely wide range of frequencies 

9 unless a printing device is used exclusively to print 
10 area fills; 

11 

12 ■ the spatial frequencies actually appearing in super- 

13 pixels 87, 91-94 selected to present the image; and 
14 

15 ■ the frequencies that occur in randomi zed-number 

16 matrices or sequences 84, 193, or other mechanisms 

17 that are used to select superpixels. 
18 

19 The invention as introduced above and as defined in 

20 certain of the appended claims is not intended to inter- 

21 fere any further than necessary with the first-mentioned 

22 group; to the contrary an objective is to preserve and 

23 reproduce those frequencies within reasonable limits. Re- 

24 citations, for example, may thus be found in certain 

25 claims to the effect that spatial frequencies other than 

26 information in the image appear substantially consistent 
2 7 in the printed image. 

28 It has been shown that the second and third groups of 

2 9 frequencies are advantageously managed separately. The 

30 second, for instance, is advantageously constrained by 

31 Fourier-prescreening the superpixels themselves; and the 

32 third by precomputing a randomized matrix. 
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□ 



1 In view of the foregoing it is believed that a person 

2 skilled in this field will find the remaining details of 

3 Fig. 16 self explanatory. 
4 

5 
6 

7 The above disclosure is intended as merely exemplary, 

8 and not to limit the scope of the invention — which is to 

9 be determined by reference to the appended claims. 
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